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Abstract. The classical sampling theorem for bandlimitcd functions has re- 
cently been generalized to apply to so-called bandlimitcd operators, that is, to 
operators with band-limited Kohn-Nirenberg symbols. Here, we discuss oper- 
ator sampling versions of two of the most central extensions to the classical 
sampling theorem. In irregular operator sampling, the sampling set is not pe- 
riodic with uniform distance. In multi-channel operator sampling, we obtain 
complete information on an operator by multiple operator sampling outputs. 



1. Introduction 

The so-called classical sampling theory addresses the problem of determining 
and reconstructing functions from countably many values that are attained on a 
discrete subset of the real line. The fundamental result in this theory is attributed 
to Whittaker, Kotel'nikov and Shannon. It asserts that a function bandlimitcd to 
an interval of length can be recovered from the values of the function sampled 
regularly at values per unit interval. 

During the last few years the herein considered sampling theory for operators 
has been developed. It is motivated by the operator identification problem in 
communications engineering. There, the objective is to identify a channel operator 
from knowledge of the channel's action on a chosen input signal. A well known 
identification result states, for example, that any time-invariant channel operator 
is fully determined by its action on the Dirac impulse. Already in the 1960s, 
Kailath [T^] and Bello proclaimed that this simple identifiability result on time- 
invariant operators could be generalized to slowly time-varying operators, that is, 
to operators whose spreading functions are supported on sets of measure less than 
or equal to one. The spreading function is the symplectic Fourier transform of 
the operator's Kohn-Nirenberg symbol. The assertions of Kailath and Bello were 
confirmed in [TBI El] . 

The identifiability results in [111 use weighted sums of regularly spaced 
delta impulses as identifiers for Hilbert-Schmidt operators with bandlimitcd Kohn- 
Nirenberg symbols. The discrete support of such a tempered distribution we shall 
refer to in the following as sampling set for operator sampling. Together with the 
fact that the classical sampling theorem can be seen as a special case of the iden- 
tifiability results for bandlimitcd operators (THl [13 [57] — consider a bandlimitcd 
function as a multiplication operator which can be determined from its action on 
a regularly spaced sum of Dirac impulses — this has led to the development of the 
herein considered sampling theory for operators. 

In this paper, we state and prove operator sampling versions of key generaliza- 
tions of the classical sampling theorem for functions. 

1 



2 



YOON MI HONG AND GOTZ E. PFANDER, 



One central extension of the classical sampling theorem considers irregular or 
nonuniform sampling sets, see [20j and references therein. In practice, sampling 
with uniform distance is hardly realizable because of imperfections in data acqui- 
sition devices or perturbations during the collecting of data. As it is similarly 
challenging to generate regularly spaced sums of impulses for operator sampling, 
the consideration of irregularly placed impulses as identifiers for operators is natu- 
ral. Here, we will give separation and Beurling density results for operator sampling 
which resemble corresponding results in the classical sampling theory for functions. 

The feasibility of the classical sampling theory for very large bandwidth signals is 
limited by the sampling rates achievable in state of the art hardware. This problem 
is addressed through multi-channel sampling as pioneered by Papoulis [23j . Multi- 
channel sampling employs a number of samplers in parallel, thereby allowing the 
acquisition of samples to be carried out in each channel at a fraction of the sampling 
rate foreseen by the classical sampling theorem. Multi-channel sampling in the 
theory of operator sampling employs similarly the combination of multiple outputs 
from sampling procedures in order to reduce the rate at which impulses have to be 
sent. In addition, multi- channel sampling for operators, that is, multiple output 
sampling for operators, allows to identify operators whose Kohn-Nirenberg symbols 
are only bandlimited to an area of measure larger than one, as shown below. Note 
that in single output operator sampling, only operators with bandlimitations given 
by sets of measure less than one can be identified. Larger bandwidth of the Kohn- 
Nirenberg symbol cannot be compensated by an increase of the so-called sampling 
rate. Q 

We formulate and prove our results for Hilbert-Schmidt operators. Means for 
generalizing such results to non compact operators arc outlined in [241 127] . 

This paper is organized as follows. In Section 2, we give some background for 
operator sampling and introduce operator Paley- Wiener spaces. In Section 3 we 
state the uniform operator sampling result for operator Paley- Wiener spaces as 
given in [26] . We include a new proof of this result, a proof that allows for gen- 
eralizations to the setting of irregular and multi-channel operator sampling. We 
give a generalization to operator classes which have not necessarily bandlimited 
Kohn-Nirenberg symbols. In Section 4, we develop irregular operator sampling 
for operator Paley- Wiener spaces. Also, we consider irregular sampling of opera- 
tors whose Kohn-Nirenberg symbol is not bandlimited in view of Kramer's Lemma 
setting. Multi-channel operator sampling is discussed in Section 5. 

2. Preliminaries 
The Fourier transform on is densely defined by 

Similarly, the symplectic Fourier transform Tg '■ — > L^(R^'*) is given by 



'Operator sampling is not simply an higher dimensional analogue of the 1-d Shannon sampling 
theorem. In the case of an operator acting on (R) , the operator's 2-dimensional Kohn-Nirenberg 
symbol is to be determined from a signal defined on R. No access to sample values of the Kohn- 
Nirenberg symbol is given, as is the case in 2-dimensional Shannon sampling theory. 
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For brevity of notation, we shall refrain from marking equalities and inequalities 
that hold in the L^-sense with the customary a.e. whenever the context is unam- 
biguous. 

Let Sn = nLihf^. ^] with n = (fii, f^a, • • • , ^d)- 
Definition 2.1. The Paley- Wiener space with bandwidth Q, is defined by 

PW{Sn) = {/ e L\W) : supp/ C Sn] ■ 

It is known that if an expansion for / G PW{Sq) converges in the norm of 
PW{Sq), then it converges pointwise and uniformly over Mf^. Note that PW{Sn) 
is isometrically isomorphic to L'^{Sq) due to Plancherel's theorem. For simplicity 
of notation, we shall denote by L^(S'si) the subspacc of L^(R'^) which consists of 
L-^(]R'') functions supported on Sn- 

The classical sampling theorem shown independently by Whittaker, Kotel'nikov 
and Shannon is generalized by the following oversampling theorem. It is based 
on possibly collecting samples more often than the sampling rate prescribes. The 
sampling rate, usually called Nyquist-Landau rate, for a function in PVK(S'n) is 
defined to be the Lebesgue measure of the set Sq. 

Here and in the following we use the notation 

A{F) X B{F), F eT, 

if there exist positive constants c and C such that cA{F) < B{F) < CA{F) for all 
objects F in the set JF. 

Theorem 2.2. For n,T > with T^Qk < 1 for all k and (p e PW{S^_^) with 
(p ~ 1 on Sq, we have a sampling expansion 

fit) = tJ2 fi^TMt - nT), f e PW{Sn). (1) 

Moreover, ([Ip is stable in the sense that 

ll/lpx ^ |/(nT)p, fePWiSn). 

In practice, a stable sampling expansion guarantees that perturbations in the 
sampling output and in the reconstruction procedure are controlled by error bounds 
on the input function and vice versa. 

The development of operator sampling necessitates the use of some rudimen- 
tary distribution theory. The space of distributions chosen here is the dual of 
the Feichtinger algebra 5o(R'*). The dual S'o(M'^) is a Banach space with 5(R'*) C 
Soi'R.'^) C i2(R'*) C S^iR'^) C 5'(R'*), where S denotes the Schwartz class of rapidly 
decaying functions and S' its dual, the space of tempered distribution. There are 
several equivalent definitions of the Feichtinger algebra Sq [6j . We choose the char- 
acterization of Sq via the short time Fourier transform. 

Definition 2.3. The Feichtinger algebra is defined by 

where Vgf{t, v) = (/, M^Ttg) is the short-time Fourier transform of / with respect 
to the Gaussian g{x) = e^'^'l"^"'. The norm on So{R'^) is given by = ||Vg/||i,i. 
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In this paper we consider the sampUng problem for Hilbert-Schmidt operators 
only. 

Definition 2.4. The class of Hilbert-Schmidt operators HS{L'^{M.'^)) consists of 
bounded linear operators on L^(R'') which can be represented as integral operators 
of the form 

Hf{x) = [ KHix, t)f{t)dt, f G L^R'i), 



with kernel kh G ^^(M^''). 

The linear space of Hilbert-Schmidt operators HS{L'^{R'^)) becomes a Hilbert 
space if it is endowed with the Hilbert space structure of i^(M''), that is, by 

{Hi,H2)hS = {HH11HH2) L^- 

In view of pseudodifferential operators, the Kohn-Nirenberg symbol an [Hill] of a 
Hilbert-Schmidt operator H is given by 



aH{x,£)^ j kh{x,x -t)e-'^'"-*--^dt. 

It leads to the operator representation 

Hf{x) = J anix, 0/(0 e^^^^^d^, f G L^iR"). 

In time-frequency analysis and communication engineering, the spreading function 
rjH of a Hilbert-Schmidt operator H is commonly considered. It is given by 

riH{t,v)^ j KH{x,x-'t) e-^^^ '^dx, 

and leads to 

H.f{x) = / [ iiH{t,v)M,Ttf{x)dtdv, f G L^{R^), (2) 



where the time-shift (translation) and frequency-shift (modulation) operators Tt 

and Ml, are defined by Ttf{x) = f{x — t) and Mi,f{'-f) ~ /(7 — i^), respectively. That 
is, a Hilbert-Schmidt operator i7 is a continuous superposition of translation and 
modulation operators with coefficient function riH- The identity ^ is understood 
weakly, namely 

{Hf, g)^ [ [ riH{t, iy){AUTtf, g) dtdv, g G L^{R''). 



As i^H — ^s<^H, operators with band-limited Kohn-Nirenberg symbols are operators 
whose spreading functions are compactly supported. 

In communications, the time- varying operator H is also commonly represented 
by its time- varying impulse response hnitjx) with 



Hfix) = J hH{t,x)f{x^t)dt, 

where /i//(i, x) = kh{x, x — t) = J r]H{t, v) e^'^'^^'^dv a.e. Note that 

\\H\\hs = \\i^h\\l^ = WhuWh^ = \Wh\\l^ = WveWl-^- 

Definition 2.5. The operator Paley- Wiener space of operators bandlimited to 
S C R2d is 

OPW{S) = {H e HS{L^{R'^)) : snppTsan C S}. 
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In the literature, operators with supp TsCth Q [ai,bi]x . . . x[a2d,b2d] are com- 
monly referred to as underspread or slowly time-varying operators if 
volumc([ai, 61] x . . . x [a2d, ^2d] = (bi — ai) ■ . . . ■ (&2d — o,2d) < 1 and as overspread 
operators else (see [16] and references within). 

We formulate the operator identification and sampling problems as follows. Q 

Definition 2.6. An operator class H C HS{L'^{R'^)) is identifiable if all H eTi 
extend to a domain containing a so-called identifier / e S'q{M.'^) with 

\\H\\HS-\\Hf\\L2. Hen. (3) 

The operator class Ji C H S {L'^ {M.'^)) permits operator sampling if one can choose 
/ in ([3]) with discrete support in M'' in the distributional sense. In that case, supp / 
is called sampling set for Ti,. 

Note that H E OPW{S) with S compact can be extended to a bounded linear 
operator H : S'o(M'^) — > L'^(R'') [SKU]. This imphes that proving identifiability 
of a Hilbert-Schmidt operator by an element in Sq is equivalent to providing the 
lower bound A in ([3]), as an upper bound is given by B = \\f\\si^ since 

\\Hfh^. < i|H||op||/||s^, < ||i?||Hsll/ll5,^, H e OPW{S). 

Given a separable Hilbert space X, a sequence of elements {fk}kez in X is called 
a frame for X if 

To each frame {/fejfcgz for X exists a so-called dual frame {fk}kez of {fk}kei. for 
X with 

f = Y.^f,fk)fk^Y.^fJk)fk, fex. 

Moreover, a frame which does not form a frame if we remove any element from it 
is called a Riesz basis, or, also, exact frame. A sequence {fk}kez is called a Riesz 
sequence if it is a Riesz basis for span{/fc}fcgz [HO [IS]. 

3. Uniform sampling of Hilbert-Schmidt operators 

Theorem 12.21 states that a bandlimited, square integrable function can be recon- 
structed by its values sampled at a sufficiently dense sampling grid. In this section, 
we first consider the sampling problem for operators whose Kohn-Nirenberg sym- 
bols are bandlimited in the time-frequency plane. We shall state and prove all 
theorems for d = 1 for convenience. 

Operators with rectangular bandlimitation on their Kohn-Nirenberg symbols are 
the starting point of operator sampling [^ \T7\ , 

Theorem 3.1. For n,T,T' > and < T'Vt <TD.<1, choose ip e PW{[-{^ - 
f ), i - f ]) with (p= \ on [-f , f ] and r e L°°(R) with suppr C [-T + T',T] and 
r = 1 on [0,T']. Then OPW{[0,T']x[—^, ^]) permits operator sampling as 

\\H\\hs = Vt\\hJ26„t\\l^, H e OPM/([0,T']x [-§,§]), 



^See | 16| for a more general concept of operator identification. 
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and operator reconstruction is possible by means of 

hnit, x) = r{t)TY,iHY,SkT){t + nT)^{x -t~nT). 

In [IS], the proof of the identifiabihty of OPW{\{), T] x [-§,§]) is based on the 
unitarity of the Zak transform. For clarity and to indicate directions for general- 
izations of this theorem, we prove Theorem 13.11 through elementary orthonormal 
basis expansions based on Fourier series. 

Proof. For almost every t e K, we have i^H{t, ■) G ^^[-f , C L'^[~^,^] and, 
by expanding rjH{t, u) with respect to the orthonormal basis 
{VTe-2"(*+"^)''}„gz of L2[-2^, 2^]' we obtain 

nGZ 

= r^/iff(i,t + nT)e-2"(*+"^)^ (4) 

SO 

mit, v) = T<^(y) hnit, t + nT) e-2-(t+»r).^ ^ ^ 

with ip chosen to satisfy G PW{[—{^ — ^), y — §]) and = 1 on [—^, §]. Then, 
for almost every t G M 

hH{t,x) = Tj2hHit,t + nT) f ^{iy)e~^"'^'+''^^''e^''"''=du 

= TYhH{t,t + nT)(p{x-t-nT), x G R. (5) 

On the other hand, we have {Hj^k ^kT){x) = J^k ^h{x — kT,x) G L'^{M.) so that 
{HZk^kT)it + nT) = J2khHit + nT-kT,t + nT). Now, r(i)(7J ^^^^ <5fcT)(i + 
riT) hH{t,t + nT) for t G [0, T'] since supp x) C [0,T'] C [0, T] . With ©, 
this gives 

hH{t,x)^r{t)TY{HYSkT)it + nT)ip{x-t-nT), a; G M, a.e. t G K, (6) 

nez feez 

a formula which contains the identifier J^kez ^kT for OPW{[0, T'] x §]). Note 
that the series in ([6]) converges pointwise and uniformly over M in x. 

Moreover, since @ was an orthonormal basis expansion, Parseval's identity gives 

\\mitr)\\l2=Tj2\hH{t,t + nT)\^=Tj2\r{t)iHj25kT)it + nT)\^, a.e. teR 
SO that 

\\hH{t,-)\\h=TY,\rmHY,hT){t + nT)\', a.e. t G R, 
nez feez 
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and 



/ \\hH{t,-)\\hdt ^ T f Y.\f'H{t,t + nT)\^dt 
T J2\hH{t,t + nT)\^dt = T ^|(H^4T)(t + nr)|2dt 



2 

L2 



= T / |(i/^4T)Wprft = T\\hY,5,t\ 

•'^ fcez feGZ 

as hnit, t+nT) and (iJ J2k ^kT){t+nT) vanish on the interval [T', T]. The operator 
class OPW{[0,T']x[-^, f ]) is identifiable by J^kez^kT as we showed \\H\\hs = 

\\hH\\L-^=VT\\Hj:,^^SkT\\L-^. □ 

One crucial ingredient in the proof above is the fact that for each t, the set 
£t = {A/re-2''*(*+"'^)''}„ez is an orthonormal basis for Note that 

the functionals corresponding to £t depend on t which is necessary to associate 
hnit, t + nT) with Hg{t + nT) for some identifier g. Another important ingredient 
is the support condition on hni-jx). It guarantees that no aliasing in the infinite 
summation H{^)^^i SkT){t + nT) takes place as for each t the sum is reduced to a 
single non zero summand hnit, t + nT). 

We assume in Theorem 13. II that the area of the rectangle [0, T']x[—^, is less 
than or equal to 1. This assumption coincides with the one given in Kailath's con- 
jecture for identifiability of such operator classes [H]. For 1 < T'il < Tft, perfect 
reconstruction of hnit^x) from its samples is not possible since the sampling rate 
^ is strictly less than the Nyquist-Landau rate for hnit, ■). In this case, not only 
operator sampling, but also operator identification by any tempered distribution as 
single input signal is not possible as shown in [28j . 

Now we extend Theorem 13.11 to the case where hnit, ■) lies in a shift-invariant 
space other than the Paley- Wiener space. Given a Riesz sequence — nT)}nez 
in L^(R), let 

Vriip) = sI5an{^(- - nT)} = { ^ c„</j(- - nT) : {c„}„ez € 

nSZ 

Let nT,<p C HS{L'^{R)) consist of integral operators iJ with hn e L^[0,T]'^VTi(p)- 
Note that different from the operator Paley- Wiener setup, not each such operator 
maps boundedly 5*0 to i^. 

We require the shift-invariant space Vt{^) to be a reproducing kernel Hilbert 
space [5]. 

Definition 3.2. A Hilbert space X of complex-valued functions on a given domain 
-D 7^ is a reproducing kernel Hilbert space if there exists a kernel k{s,t) defined 
on X D satisfying k{-,t) G X for allte D and f{t) ^ {f{-),k{-,t))x for all f e X 
and t Cz D. Such a function k{s,t) is called a reproducing kernel. 

For example, if is a complex- valued integrable function well-defined everywhere 
in R and satisfies 

nez 

then Vi (i^) is a reproducing kernel Hilbert space [13| . Alternatively, if (p is continu- 
ous and belongs to the Wiener amalgam space W{L°^,l^), that is, to the subspace 
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of L^(M) defined by the norm 

ll</5||iv(L°=,;i) = V sup |</j(t + 7i)| < oo, 

then Vi{ip) is a reproducing kernel Hilbert space as weU [1]. 

Theorem 3.3. Assume that Vt{^) is a reproducing kernel Hilbert space and its 
reproducing kernel k{s,t) satisfies the condition that {k{-,t + nT)}ni=z is o, frame 
for Vt{^p) for each t g [0,T]. Then '^kfzx^kT identifies Ti-T.Lp, that is, 

\\H\\Hs-^\\HY,^kT\\L-, HeHr^^. 

The reconstruction of operators is possible by 

hnit, x) = X[o,T] W ^(i? ^ 4T)(i + nT)k*„ix, t), 

riGZ fceZ 

where {fc*(-,t)}„gz is o, dual frame of {k{-,t + nT)}nez for a.e. t £ [0, T]. 

Proof. Since hnit, •) £ Vriifi) and {fc(-, t + ?T.T)}„gz is a frame for Vt{(p) for each 
t€[0,T], 

hH{t,x) = Y.(^H(t,-),k{-,t + nT))k*^{x,t) 

nei, 

where {A;* (•, is a dual frame of t+nT)}ni=z- Since fc(s, t) is a reproducing 

kernel of Vr (</?), 

/i_f/(<, a;) = ^ t + nT)k^{x, t) 

and 

nez 

Formally, we have iHj2kei- ^kT){t + riT) = X^fcez ^nit + nT -kT,t + nT) so that 
r{t){HY,5kT){t + nT) = hH{t,t + nT) 

where r{t) — X[o,T]{t)- Together with ([7]), we note H^k^zz^kT G i^(R) and we 
conclude 

\\hH\\l. = \\H\\\s ^ f Y.\^HY,5kT){t + nT)\'dt^\\HY,6kT\\l.. 

□ 

Example 3.4. Let T = 1 and take Lpit) = X[o,i)(0- Then Vi(iy9) is a reproducing 
kernel Hilbert space and its reproducing kernel fc(s, t) allows {fc(-, t + n)}„gz to be a 
frame, in fact, an orthonormal basis for Vi (93) since k(s,t) ~ J2nez X[n,n+i) {s)x[n,n+i) 
Hence, for t e [0, 1], 

k{s,t + n) = E Xlrn,m+l){s)xim,ni+l){t + n) = ^ X[m,m+1) (s)^n,m = «+!)(«)■ 

We conclude that X;fc ^fe identifies H ^ {H e HS{L^{R)) : hn G ^^[0, 1] ® Vi{ip)}. 
For H E H, the kernel kh{x, t) is a step function along diagonals x = t + c, c G M. 
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4. Irregular sampling of Hilbert-Schmidt operators 

First, wc provide the background on irregular sampling of functions that is 
needed to develop operator sampling results based on irregular sampling sets. 

4.1. Irregular Sampling in Paley- Wiener spaces. 

Definition 4.1. Let A = {Xkjkei. ^ with < A^+i, k e Z. 

(1) A is a set of sampling, also referred to as stable sampling set, for 
PW{[~'4,'4]) if 

ll/lli^>=E 1/(^^)1'' /ePmhf,f]). 

kez 

(2) A is a set of interpolation for PW{[—^, ^]) if the interpolation or moment 
problem 

f{\k) = ck, ke z, 

has a solution in PW{[-^, §]) for every {ck} e P{Z). 

(3) A is uniformly discrete if, 

{Xk+i - Xk) > S > 0, keZ. 

In this case 5 is called a separation constant. 

(4) A is relatively uniformly discrete if A is a finite union of uniformly discrete 
sets. 

(5) The upper and lower Beurling densities are defined, respectively, by 

i?+(A) =limsup^^^ and i?-(A) = liminf ^^i^, 

where for ft, > 0, n^{h) and (h) are the largest number and smallest 
number of points from A in [x — ^,x+^), a; g R, respectively. If Z)+(A) = 
D~(A), then we say that A has uniform Beurling density D{K) = Z)+(A) = 
D-iA). 

We recall necessary and sufficient conditions on the Beurling density of a set 
A ~ {AfejfcGZ for its nonharmonic sequence to be a frame or a Riesz sequence for 

Theorem 4.2. 

c ch nT ortmnl'im n rnr l-^\A/ I l_ — . 

2 ' 2 



(1) A is a set of sampling for PW{[-^, §]) if and only if {e~^"^''^}fegz is a 
frame for ^, Moreover, for A being relatively uniformly discrete, 
a necessary condition for {e~^'^'^'^^}fcgz to be a frame for _L^[- 



IS 



D (A) > n, and a sufficient condition is D (A) > VL. 



(2) A is a set of interpolation for PW {[— ^ , ^]) if and only if {e~'^^'^^^^}kez *s 
a Riesz sequence in ^, Moreover, for A being uniformly discrete, a 
necessary condition for {e~^'^*^'=^}fcgz to be a Riesz sequence in L^[— ^, ^] 
is [A) < Q, and a sufficient condition is D^{A) < fi. 

In general, it is highly non-trivial to determine whether a set {e~''^^'^^''^}k£Z is a 
Riesz basis for L^[—^,^]. A famous affirmative result was given by Kadec [11]. 

Theorem 4.3. (Kadec's 1/4-theorem) Let A = {\k}kei. C R. // there is L > 
such that 

\Xk- ^\<L< ^, keZ, (8) 



10 



YOON MI HONG AND GOTZ E. PFANDER 



then {e '^'"^'^''^}kez. is a Riesz basis for L'^[~^, and is the best possible con- 
stant for ^ to hold. 

4.2. Irregular sampling in Operator Paley-Wiener spaces. 

Definition 4.4. A sequence A = {Xk}kei, in M is a set of sampling for an operator 
class H, if for some {ckjkei. € 1°°{Z), we have Y^kez, Cfef^Afc & S'q{R) and Y^kez ^k^x^ 
identifies H. 

Operator sampling is operator identification with discretely supported identi- 
fiers. Consequently, irregular operator sampling for OPW{[0,T]x[—^, ^]) is a- 
priori possible only if Tfl < 1 [T^l [13 • 

Theorem 4.5. TQ < 1 is a necessary condition for the existence of a sampling set 
for OPM/([0,T]xh §,§]). 

Analogous to Theorem 14.21 we have the following result. 

Theorem 4.6. If A = {Xk}kei.j ^k+i > ^k, uniformly discrete, then a necessary 
condition for A being a set of sampling for OPW{[0,T]x[—^-, §]) is D~(A) > Q 
and a sufficient condition is D~ (A) > f2 and Xk+i — ^k^T. 

Proof. Assume that A is a set of sampling for OPVt^([0, T] x ^]) with 
(A) < D,. Then there exist C and C > such that 

k£Z feez 
since for each x there exist at most [^J + 1 nonzero summands above where 5 = 
inffe(Afc+i - Xk). But as ^-(A) < there exists / e PW{[~^, f ]) with ||/j| = 1 
and Efc < l/i'^C). Defining H by KH{x,y) = f{y) for < a; - j/ < T, 

kh = else, we have kh[x, Xk) = fiXk) for Aa_, < x < + T and else. 
We have 

T = \\H\\%s < CY,\\^H{x,Xk)\\' = Cj2T\f{Xk)\' < CT/2C = r/2, 

kez feez 

a contradiction. 

Now we shall establish the sufficient condition for A to be a set of sampling. As 
A is uniformly discrete and D^{A) > fi, {e^^"-^''^}fcgz is a frame for L^[— ^, 
Theorem 1421 (1) imphes that A is a set of samphng for PVF([-§, §]) and for t e R, 

x^|/iH(t,i + A„)|', i?eOPM/([0,T]x [-§,§]). 

nez 

As Afc+i-Afe > T, k e Z,we conclude that A is a set of sampling for OPW{[0, T] x 
since for H e OPW{[0,T]x[-^, f]), 

\\H\\%S = \\hH\\h = r \\hHit,-)\\'dt ^ r Y.\^H{t,t + Xn)\^dt 

■^0 -^0 „ez 

= fY.\^HY,K){t + ^n)?dt < \\HY,5xA\h. 

□ 

In the remainder of this section, we shall discuss the separation condition {Xk+i — 
Xk) > T, k ^ 1^, on the sampling sequence {Afc}fe6Z for 
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OPW{[0,T]x[—^, ^]). This condition rules out aliasing in the sense that for each 
X, the sum X^nez f^H{x~ A„, x) = X^nsz i^Hix, A„) has only one nonzero summand. 
Consequently, the sufficient condition on A = {Xk}kez for being a set of sampling 
for OPW{[0,T]x[~^, f ]) given in Theorem HI] implies 

n<D-iA)<D+{A)<^ 

so that Tfl < 1. Theorem 14.51 shows that this is not an additional restriction on 
operator Paley- Wiener spaces to allow for irregular operator sampling. 

Corollary 4.7. If A {Xk}k€i., Xk+i > Xk, satisfies \Xk - kT\ < L < ^ for some 
L > andXk+i-Xk >T,k€Z, then A is a set of sampling for OPW {[{),T]x[-^, f ]), 
TVl < 1. 

Proof Since \Xk - kT\ <L<^, {g-27riAfcC| ^ j^j^^g^ basis for L'^[-^,^] by 
Theorem 14.31 If Til < 1, the result follows directly from Theorem 14.61 The case 
TO = 1 follows analogously. □ 

Note that the hypothesis on A in Corollary 14.71 is satisfied if and only if Xk = 
kT + ek with 

1 1 

-- < -L < . . . < e_2 < e-i < eo < ei < £2 < ■ • • < i < ^■ 

Theorem 4.8. Let A = {Xk}k<£Z, Xk+i > Xk, be a set of sampling for 
OPM^([0,T]x[-f , §]) and let {e-^'''^>'^}kez be a Riesz basis for L^[-^,^], then 
{Xk+i -Xk)>T,ke Z. 

Proof It is easy to see that if {e^^'^^-^'^^j/jg^ is a Riesz basis for L^[— ^, ^] and 
EfeGZ Cfcf^Afc is an identifier of OPW{[0, T] x [-f , f ]), then Ck ^ for all G Z. 
Assume A/^i — Xi < T for some I. For such I, set 

kh{x, Xk) 

and kh{x,Xi) 

and kh{x,Xi+i) 

The freedom of choice of values for kh(x, Xk) is justified by Theorem l4.2l (2). Then 
HJ2k£z'^kS\^{x) = J2kei.'^kHH{x,Xk) = for ah a; G M, but as q,c/+i 7^ 0, we 
have Kfj 7^ and therefore H 0. □ 

Example 4.9. Theorem 14. 81 implies that {A„}„gz — {2n}„gz U {2n + Q;}„gz with 
< a < 1 is not a set of sampling for OPW{[0, l]x[— i, i]). 

The condition (Afe+i — A^.) > T, fc G Z is not necessary for operator sampling 
of OPI^([0,T]x [-§,§]) if {e^^^^^^lfcez is not a Riesz basis but a frame for 

[-2", 2-J- 

Example 4.10. The tempered distribution X]fcez(^f )'''^- identifies 

oPM/([o,i] X hi,i]) Eg. 

To illustrate the rigidity of operator sampling in comparison to function sam- 
pling, we add the following simple example. 



= iik^ 1,1 + 1 

Ci+i if A;+i < X < A; + T 

otherwise 

-ci if A/+1 < X < A; + T 
otherwise. 
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Example 4.11. Let = {Xk}k€i be given by A/c = fc for A; 7^ and Ao = r e M. 
The set is a set of sampling for PW{[~^, ^]) if and only if ?- ^ Z \ {0}. To 
sec this, note that as {e^"'^^}fcgz is a Riesz basis for i, i], so is {e^"'^^}fe^o U 
|g27rjr4| if r ^ z \ {0}. By Theorem gH A^ = {Xk}kei. is a set of sampling for 
OPW{[0, 1] X [- i , i] ) if and only if r = 0. 

4.3. An operator version of Kramer's Lemma. Kramer's lemma plays a cru- 
cial role in the proofs of a number of important sampling theorems. For example, 
it allows for sampling series expansions for functions which are integral transforms 
of type other than Fourier one. For example, Bessel-Hankel, Legendre, Jacobi, 
Laguerre, Gegenbauer, Chebyschev, prolate spheroidal, and Hermite transforms 
can be considered, where each transform is defined as an integral transform whose 
kernel is its special function [HI [HJ [21]. In particular, if a function on has a 
circular symmetry, then a multi-dimensional Fourier transform can be reduced to 
a one-dimensional Bessel-Hankel transform [22] . 

Theorem 4.12. (Kramer's Lemma) Let / C R foe a hounded interval and k{-,t) £ 
L'^{I) for each fixed t in D CM.. If there is a sampling sequence {tri}„gz in D such 
that {k(£^,tn)}nez forms a frame for L^[I), then for any f(t) = (i^, fc(-, i))^2(/), 
F G L'^{I), we have 

where the reconstruction functions Sn are given by 

with {fc„(^)}„gz a dual frame 0/ {fc(^, t„)}„gz- 

The original Kramer's lemma assumed that {fc(^,t„)}„gz is an orthonormal ba- 
sis for L'^{I) [HI [T7]. However, we can easily see that the result extends to the 
case where {fc(^,i„)}„gz forms a frame. We remark that the classical sampling 
theorem addressing / in PM^([— i,^]) is given by Kramer's lemma if we take 

^(^i^) = e^'^*^*,^ — f and use the fact that {e^'^^^jngz is an orthonormal ba- 
sis for i]. 

Let / C M be bounded. For 

/C : L\I) L\R), F ^ {F{-),k{x, •)>l2(/), (9) 

bounded, set 

n''is) = {H e HS{L'^{R)) 

: hH{t,x)^{CHit,-),k{x,-))L2, Cff ei'(]Rx/), suppCifC5}. 

Clearly, for k{x, v) = g-^"''^ we have rC'iS) = OPW{S). 

Theorem 4.13. Let H e n''{[0,d] x /), d > 0, I in R bounded. If there is a 
set {yn}n& such that {kit + yn7i')}nGZ forms a frame for L'^(I) for every 

t € [0, d\, and d' = inf (?/„_|_i — y„) > d, then exists c > with 

\\H{Y,5y,)\\L2>c\\H\\HS, H enH[0,d]xI). (10) 

feGZ 
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// the map K, in 0^ is hounded below, then 

\\H{Y,5y,)\\L^.^\\H\\Hs, Hen'{[0,d\xl), (11) 

feez 

and operator reconstruction is possible as 

hH{t,x) ^ r{t)^{H^6yJ{t + yn)(j)n{t,x), 

nGZ fcGZ 

where (j)n{t,x) is given by 



(j)n{t,x) ~ J k^{t,h')k{x,i')dv 

with {fc* (t, v)}n& being a dual frame of {k{t + yn, v)}n£Z for each t and r = I on 
[0, d] with suppr C [rf — d' , d']. 

Proof. As iidk{yk+i — yk) = d' > d wc have 

r{t){Hj2^yJit + yn) = r{t)Y,hH{t + yn - yk,t + yn) = hH{t,t + yn), t € E, 
fcez fcez 

where r = 1 on [0, d] and suppr C [d ~ d', d']. Consequently, 

llCfflli^ = J WCHit, ■ )\\h dt^J UiCnit, ■ ), k{t + yn, ■ dt 

= J \\{hH{t,t + yn)}\\pdt^ J J2\'T'Hit,t + yn)fdt 

nGZ 

= /EH^~y")(^E'^vJ(i)i'rf^ = E \HY.Sy,{t)\^dt 

•' nSZ fcez n£Z''y^ fcGZ 

= j \HY.5yM?dt = \\HY,5y,r, Hen'md]xi). 

fcez fcez 

We used the fact that r{t-yn){H J2k!^i,Svk){t) = Sfeez ^ ^ [Un^Un+d] 
and r{t - yn){H J2k<£Z^yk)it) = for i € [?/„ + d, y„+i), nGZ. 

Equations PH)) and (fTT|) follow from the fact that K, is bounded and the hypoth- 
esis that JC is bounded below, respectively. 

Moreover, we have, for v € I, 

CH{t, v) = ^{C,H{t,v),k{t + yn,v)) L'^k*^{t,v) = ^ hH{t,t + yn)k^{t, v), 

n^Z neZ 

where {fc* (t, j/)}„gz is a dual frame of {k{t + yn,i^)}nez for each t. Multiplying 
k{x, v) and integrating with respect to v on both sides, we have for fixed t S [0, d] 

hH{t,x) = E hH{t, t + yn)(f>n{t,x), X G R, 

nez 



where 4>nit,x) = Jj k^{t,v)k(x,v)dv. □ 
Note that a set of sampling {yn}n£Z in Theorem 14.131 is uniformly discrete and 
a separation constant d' is greater than or equal to d. On the other hand, the 
condition that {k(t + yn, i^)}nez forms a frame for L^{I) indicates that the sampling 
points should not be too sparse. 
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Remark 4.14. Unlike Kramer's Lemma for functions, we do not have any explicit 
example for operator sampling other than the OPW{S) case. Sampling theorems 
based on various kinds of orthogonal polynomials generally do not satisfy all hy- 
potheses in Theorem 14.131 For instance, for the Bessel-Hankcl transform, we have 
k{x^v) — ^/xvJn{xi') where J„ is the Bessel function of the first kind of order 
n. Taking Afc as the fc-th positive root of Jn{x), one can, in fact, obtain a sam- 
pling expansion induced from Bessel-Hankel transform [9]. However, the kernel 
k{x, v) = ^JxI'Jn{xv) does not allow for {k{t + y„, i^)}n<£Z being a frame for each t. 

In Theorem 13. II we used the fact that {m(!/)e~^'^""^}„gz forms an orthonormal 
basis for L^[— i] for any function m satisfying = 1. In general, we have 

the following. 

Proposition 4.15. For D,I CM. and k{x, v) defined onS. x I, let k{x, v) satisfy 
k{t + Xjiy) = m(t, h')k{x, i^) for some m such that < ||m(t, •)||o < ■)\\oo < oo 

for all t € D. If {k{yn, v)}nez is a frame for Lp'{I), then {k(t -\- yn, i^)}nez "is also 
a frame for L'^{I) for all t G D. 

For example, the Fourier kernel k{x, v) = e^^'^*^'^ and the Hilbert transform 
kernel k{x, v) = — isgn(zy) er'^'^^^'^ satisfy the hypotheses of Proposition [4151 

5. Multi-channel sampling for Hilbert-Schmidt operators 

In classical multi-channel sampling, a signal is reconstructed using discrete values 
from the outputs of N different time-invariant operators applied to a single input 
signal. Generally, each of the N outputs is sampled at -^-th of the Nyquist-Landau 
rate of the input signal. For example, when the signal's bandwidth is Hz, then 
we should collect at least VI samples per second. But if we design N channel filters 
appropriately, then it suffices to obtain U,/N samples per second from each channel 
and combine the samples in order to reconstruct the signal. This allows us to reduce 
sampling rate requirements on sampling hardware at the cost of employing multiple 
samplers. 

A number of important theorems, for example, on periodic nonuniform sampling, 
on derivative sampling and on samples of Hilbert transforms can be explained in 
the framework of multi-channel sampling [31 [S] ■ In |10| , multi-channel sampling 
has been developed for abstract Hilbert space, allowing each channel output to be 
sampled at different, irregular points. 

In Sections 121 and m it has been shown that a slowly time-varying/underspread 
operator is identifiable by a single channel output while in [1^1 [H] it is shown 
that an overspread operator is not identifiable in this sense. However, in this 
section we shall show that overspread operators may be recoverable from multiple 
channel outputs. In addition, we seek to reduce the rate at which delta impulses 
are produced for channel identification. 

Throughout this section, we shall consider Hilbert-Schmidt operators whose 
Kohn-Nircnberg symbols are bandlimited to rectangular domains. 

Theorem 5.1. ForM,Ne N, OPW{[0, N]x[-^, ^]) permits multi-channel op- 
erator sampling as 

MN-l 
j=0 n6Z 
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Proof. Suppose that t]h e L'^{[Q, N]x[-^, ^]) for some M,N e N. Consider 
an orthonormal basis {-^ e"2'^*(*+^)''}„gz for L^[-§, t e [0, N]. Then 



and 

hnit^x) = ^ hHit,t+^) sincAf(x -t- fj), x e M, a.e. t G [0,iV]. 

Since {VM sincM(- - 1 - f[)}nei is an orthonormal basis for PW{[-^■, ^]), Par- 
seval's identity gives 

\\hH{t, Oll^ ^iiY. \^H{t, t + fj)\\ t e [0, N]. 

nez 

Hence, we have 

AT rN _ 

"dt 



\hH\\h(^R2^ = / l|/iif(t,-)lli2(K)rfi - 17 / ^|/iH(t,<4 

r=0 A/ riGZ 
„J_ A/Af-1 

1 A/Af-1 

= ii l' J2 J2\''H{t+ij,t+f,)\'dt. 



M' 



r—Q nGl 

Since {HEn ^%)(^ + ^) = E„ +^^17^^+^)' fixed t € 

[0, jj], we have 



/A/JV " ^ Al Al ' " ' Ai / VA/W 

n6Z r=0 



where r(t) = X[o,a.](0- Similarly, consider {HJ2n^^^j^w^i^) ^here 
g27rjj7A/Ar^ j = 0, 1, • • • , MiV - 1. Then 

(^E 7nA-"%)(^ + ^) = E Ja'^^(^ + ^-T^^t+U 

n n 

For fixed [0,^7], 

MN-l ^_ 



/MN ' M' ' M' ^MN 

nGZ r— 
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Consider the system of linear equations 



r{t) 



(^E„^%)(t+i7) 



(HE, 



^AIN -1 



hH{t + 



AIN-l 
M 



where all matrices arc unitary MN x MN DFT matrices with entries given by 
{Ak)j,i = g27rt{j-i){k~(i-i))/MN _ ^^^^^ ^^,g unitary, we have 



/MN "AT 



\\{hH{t,t+^)}k\\i2 

\\{hH{t+ij,t+^)}^\\l. 



\{hH{t+ 



MN-1 
M ■ 



where || • |j denotes the i^[0, 



1 ]MN 



norm. Therefore 



.J- MN~1 



\hHr 



kez j=o 

MN~1 



1^/ E K^E 

•'^ j=0 jiGZ 



3=0 

m E 1I^E-"%I 

J=0 riGZ 



2 

L2( 



□ 

Clearly, the matrices A^ can be replaced by appropriate sequences of matrices 
whose norms are bounded above and away from zero. 

Theorem 5.2. Let AI, N G N and {cj,n}jL^ nez bounded with Ak, k £ Z, invertible 
with \\A]:^\\ < C < oo where {Ak)j,i=i,...^MN = cj^k-i+i- For fj = J^nez'^j.^iS^ , 
1 !i j !i MN , we have 



ml 



HS 



MN 

E 11^/: 



He OPM^([0,iV]x[-^,f ]) 



The assumption in Theorem l5.2l is satisfied if for all j, {cj^n}ni£Z is AfA'^— periodic 
and Aj Q is invertible with ||^Jol| also uniformly bounded. 

Now we consider periodic nonuniform sampling as first proposed by Yen [30j . We 
first recall periodic nonuniform sampling theorem for functions in PW{[—^, ^]). 

Theorem 5.3. There exists a Riesz basis {Sj{t - if )}jli,„gz for PW{[-^, f ]) 
such that 

N 

fit) = E E /(if + - if). / e pwii-'^, §]), 

j=l nGZ 



where < aj < , I < j < N , and ai ^ aj for i ^ j. 
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We show that OPW{[0, N]x[~^, f-]) is identifiable by MN identifiers which 
are given by delta-trains whose supports are periodically nonuniformly distributed. 

Theorem 5.4. For AI, e N, and < ai < a2 < • ■ • < cumn < N, we have 

MN 

mis ^ E ll^(E H e OPW{[0,N]x[-f, f ]). 

Proof. If we apply TheoremESlto hnit, •) E PW{[-^, f-]) with MN channels, 
then we obtain 

MN 

hH{t,x) = E E hH{t,t + nN + aj) ipj[x - t - nN), x € R, a.e. t £ [0,N], 
j=i nez 

and 

MN 

\\hH{t, Oil' E E l'^^^*' t + nN + a,)\\ a.e. t G [0, N], 

j = l nSZ 

where Wjix-t-nN)}fJ[„^^ is a Riesz basis for PW{[~^, f-]) for each t G [0, N]. 
Therefore, we have 

.N MN 

ii^^iilfs = ii/^Hiii^ ^ / EEi'^ff(^'^ + ^^^ + "j-)i'rfi 

•^0 j=l «GZ 
MN N 

= E/ Ei^(E'^^^+".)(^+^^^+"^)i'^* 
= Eii^(E'5'=^+".)iii^' 

that is, {Efcez WaJ^i^ identifies OPW{[0, N]x[~§, f ]). □ 

Remark 5.5. Note that as in the multichannel sampling theory for functions, 
Theorem l5.4l can be applied to reduce the rate of impulse transmission. For example, 
as OPW{[0, l]x[-i, i]) C OPW{[0,N]x[-^, i]), we can identify any operator in 
OPM^([0, 1] X [— i, i]) by its action on the tempered distributions J2nez,^nN+ja, 
< a < 1, j = 0, . . . , — 1, each of which has impulse rate 

Another important multi-channel sampling concept can be applied to operator 
sampling, namely, derivative sampling. We apply a multi-channel sampling formula 
consisting of samples of / and its MN — 1 derivatives [TSl [H] . 

Theorem 5.6. For M, N eN, we have 

MN-l j , .s 



m\s^ E IE J(-ir(^EO^'"^' , i7eoPT^([o,A^]x[-f ,f]). 

Here, ' denotes the r-th derivative of / in the distributional sense. 

Proof. If we apply multi-channel derivative sampling theorem to knit,-) G 
PW{[-^, ^]), then we obtain 

MN-l 

hH{t,x)^ E ^-Q—hH{t,x)\x=t+nN'P3{x-t-nN),xeM.,a.e.te[0,N], 

j=0 nSZ 
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and 

\\hH{t,-)\\''- ^|^/iH(i,a:)U=t+„jv|', a.e. [0,7V], 

j=0 yieZ 

where {^j{x — t — 'n-N)}j'^~^^ is a Riesz basis for PW{[—^, ^]) for each fixed 
t G [0, A^]. Let Hj be the operator defined through the j-th derivative of hnit,-), 
that is, 



f 

H,f{x) = j —hH{t,x)f{x^t)dt 



a.e. 



Since supp x) C supp x), we have 

XlO,N]{t){Hj22^kN){t + nN) = -^hHit,x)\^^t+nN, 



dx^ 
fcez 



so that 



\hHf 



MN-1 



Observing that Hjf{x) = X]r=o {i)(^^y (i^/^'^')'"' by Leibniz's rule completes 
the proof. □ 
We conclude this section by presenting two explicit multi-channel reconstruction 
formulas for operators. 

Example 5.7. Consider the Riesz bases {e-2'^'(*+2")''}„gzU{-27rw e-2"(*+2")'^}„gz, 

t e R, of L2[-1/2, 1/2], as well as their Riesz basis duals given by {2(l-2|i/|) e-2"(*+2")'^}„gzU 
{f sgn(:/)e-27r»(t+2n)i.}^^^ [g] ^ We obtain 

n 

+ •)' -2^^ • e-2"(*+2")-) I sgn(z.) e-2-(*+2")-, e [- 

n 

Taking an inverse Fourier transform with respect to the variable v, we have 

d_ 

dx 



2 ' 2J 



hHit,x) = Y,hH{t,t+2n)Snit,x) + ^hH{t,x)l,=t+2nTnit,x), X G M, < G [0,2]. 



where 



Sn {t,x) = sinc^ i (a; — t — 2n) 



and 

Tn{t,x) = |sinci(x-i-2n)sinf (a:-<-2n). 
We give a second reconstruction formula for the operator class OPW{[0, 2] x [— i, i]). 
Example 5.8. Let H e OPiy([0, 2] x [-i, i]). Then for < a < 1, 

= E '^2fc)(i+2n)5i(x-t-2n) + (i/ ^ (52fc+a)(t+2n+Q)S'2(x-t-2n-a), 
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where the reconstruction functions are 

= -^i^'" (e""X[_.,o)(-) - X[o4](-)) (^) 

and 

S^i-) - ^^l^'" (-X[-io)(-) + e^^"X[o,il(-)) (-). 
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